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Abstract. A fluctuation relation, which is an extended form of the Jarzynski equality, is 
introduced and discussed. We show how to apply this relation in order to evaluate the free 
energy landscape of simple systems. These systems are manipulated by varying the external 
field coupled with a systems' internal characteristic variable. Two different manipulation 
protocols are here considered: in the first case the external field is a linear function of time, 
in the second case it is a periodic function of time. While for simple mean field systems both 
the linear protocol and the oscillatory protocol provide a reliable estimate of the free energy 
landscape, for a simple model of homopolymer the oscillatory protocol turns out to be not 
reliable for this purpose. We then discuss the possibility of application of the method here 
presented to evaluate the free energy landscape of real systems, and the practical limitations 
that one can face in the realization of an experimental set-up. 
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1. Introduction 



In the recent years, a number of manipulation experiments have been performed with the 
aim of gathering information on the equilibrium properties of complex molecular systems, 
such as biopolymers [[]]]. In particular, in a class of these experiments the Jarzynski equality 
(JE) [Q, H ||, |5p has been exploited in order to evaluate the equilibrium free energy landscape of 
the system, even if the system is no more at equilibrium during the manipulation experiment. 

In the present work, we wish to investigate under what conditions the use of the JE 
in its several forms is effective for the evaluation of the free energy landscape of a small 
system. Indeed, the JE requires the evaluation of the average of exp(-/3W), where /? = 1 /k^T 
(T is the temperature) and W is the work exerted on the system. This quantity has a wide 
distribution, even if the distribution of W is comparatively narrow, and it is not clear a priori 
when sufficient statistics for its evaluation can be mustered [H]. Typically one wishes to 
evaluate the free energy landscape of the system as a function of a collective coordinate M 
which accessibly represents a semimacroscopic state of the system. For example, in the case 
of pulling experiments, one takes for M the elongation of the molecule. One thus needs to 
introduce extended forms of the JE in order to evaluate the detailed free energy landscape as 
a function of the internal characteristic variable. By combining the JE and the the histogram 
method (cfr. [0, ||, ^|, [K}) one is able to evaluate the free energy of a constrained equilibrium 
state in which the collective coordinate assumes a fixed value. 

The article is organized as follows. In section 0, we derive the extended form of the 
JE, which connects the work done on a manipulated system to its free energy landscape. In 
section |3] we review the histogram method and show how it can be exploited to evaluate free 
energy landscapes of manipulated systems. We then apply the histogram method to evaluate 
the free energy landscape of a mean field Ising model, section |], and of a simple model of 
homopolymer, section [5|. We discuss our results and conclude in section^]. 



2. The basic identity 

We shall now briefly recall the derivation of the basic identity of the histogram method. 

Let us consider a system described by the hamiltonian "HoM, where x identifies its 
microscopic state. Let us also assume that the system is originally at equilibrium, so that 
its distribution in phase space is described by the canonical distribution function 

e -m>(x) 

PoO) = — ~ — , (1) 
A) 

where 

Z = j dxe-^ o{x) (2) 

is the corresponding partition function. We shall assume that the system is manipulated in 
the following way. Let M(x) be an observable quantity (a sufficiently smooth function of the 
microscopic state of the system) and U^(M) a function of M, dependent on a parameter p. In 
the initial state, without loss of generality, we take p = and U (M) = 0. The manipulation 
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protocol is defined by assigning a function p(t), (0 < t < f f ), where p(0) = and /i(f f ) = p. The 
time-dependent hamiltonian of the manipulated system is < Hf 1 (t){x,t) = 'HoW + U^ t ){M(x)). 
The work exerted on the system up to time t is a random quantity which depends on the 
trajectory x(t) that the system follows in phase space: 



, dUJM(x(f)) 
W= dt'p(t')- 



(3) 



dp 

The joint probability distribution 0(x, W, t) of the microscopic state x and the accumulated 



work W satisfies the partial differential equation [0, [TTJ, \[Q |T3j] 

m r ^ ■< dU Kt) (M(x)) d® 

^=L^-pit) - — . (4) 

Here, is an evolution operator whose equilibrium distribution, for any p, is the canonical 
distribution defined by the hamiltonian < H fl {x) = 'Ho(x) + U^(M(x))\ 

-C, —=— = 0, (5) 

A' 

where, of course, Z fM = fdx e-^W. Let us now define the generating function ^(x, A, t) of 
the distribution of W via the equation 



Then *¥(x, A, t) satisfies the differential equation 

¥ = v + w ^ ¥ " (7) 

One can then easily check that, for A = -fi, the corresponding equation and the initial 
condition *P(x, A, t=0) = p Q (x) is identically satisfied by 

W(x,-p,t) = — 5—- (8) 
Integrating this relation on jc one obtains the usual form of the JE: 

(e*") ( = J dx J d W c*" <D(*, W,t) = ^= exp [-0 (F m - F Q )] (9) 

Here is the partition function corresponding to the hamiltonian "HoW + U M (M(x)), and 
^ = -kv,T lnZ^ is the corresponding free energy. A more general relation is obtained if we 
multiply both sides of eq. (jSJ) by 6(M - M(x)) before integrating: 

dx 5{M - M{x))— — = e^[ ro(M)+ ^'> w -H(10) 

Here To(M) is the free energy of a constrained ensemble, in which the value M(x) is fixed at 
M: 



I 



T (M) = -k B Tin I dx 6(M - M(x)) Q~ m<s{x) . (11) 



Note that eq. ( JTOt ) corresponds to eq. (21) in Crooks (ref. |Q]), with the substitution f(x) = 
5{M - M{x)). It generalizes the expression by Hummer and Szabo (eq. 4, ref. |Pp) to the 
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case in which the state of the system is represented by a collective coordinate. In this case 
the expression on the rhs of eq. ( |T(1| ) involves a free energy function rather than a microscopic 
hamiltonian. 

By multiplying both sides of eq. ([H]) by e /3J/ ' ,( ' )(M) , we obtain the basic identity of the 
histogram method: 

ju m m _ M(x))e -pw^ = Q -pmm-Fo\ (12) 

Equation ( |12| ) provides thus a method to evaluate the unperturbed free energy Tq(M) as 
long as one has a reliable estimate of the lhs of this equation. Note that that the quantity on 
the rhs of eq. ( |12| ) is a time independent quantity, and thus an improved estimate of To(M) 
can be obtained by sampling the rhs of eq. ( |12| ) at different time t along the manipulation 
process. The problem is that the quantities so obtained are not equally distributed, and so, 
their statistical treatment has to be performed conveniently, as described in the next section. 

Equation ( |12[ ) can be viewed as an extension of the JE @. This last equation 
provides a method to evaluate the equilibrium free energy difference AF, between the two 
thermodynamical states characterized by the external parameter values fi(t) and /i(0): one can 
in fact evaluate the quantity AF* defined by the following equation 

i Aft* 

e -w = _Ly e -w Ee -m (13) 

i= i 

The best estimate for AF, will thus be given by AF, AF*. 



3. Histogram method for the evaluation of the free energy landscape 

Let us assume that we have n random variables jc,-, i = 1, . . which are not identically 
distributed, but have the same average value (jc,-) = X. We wish to estimate X from a given 
sample {x,} of the x,'s. Let us write the quantity x, as a product of a random variable £ and of 
a non-fluctuating factor a,, 

xi = £a ; . (14) 
One can obtain an estimate X p of X from the set of data {x,} by a linear combination 



n n 



X P = P' Xi = Pi & ai ' ( - 15 ' ) 

1=1 1=1 

where the coefficients pi satisfy 

n 

Pi >0; Yj pi = h (16) 

i=l 

The best estimate of X is obtaining by minimizing the variance 

AX 2 p = (X 2 p ) - (X p f (17) 
of the fluctuating quantity X p , under the constraints (|T6T). If one has 

of = (^)-<6> 2 , (18) 
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the variance of X p is given by 

N 

AX 2 p = J]ptferl (19) 
By minimizing AX 2 ,, we thus obtain the following expression for the coefficients p\\ 

Pi = -4-5.* (20) 
afo-f 

where A is a Lagrange multiplier, which is fixed by the normalization condition of the 
coefficients pf. 



A' 1 



Yu-T-2- (21) 



i a i°"i 
(=1 i i 



The best estimate of X is thus given by 



where /I is given by eq. (pj). 

As discussed above, we want to evaluate the rhs of equation ( |T2| ) by sampling the 
experimentally accessible quantity which appears on the lhs of the same equation. We 
thus consider a number iVtraj of repetitions of the experiment, and sample the corresponding 
trajectories at discrete times tj = j St. We also divide the interval of possible values of M into 
bins B e = [M e , M c + 5M C ). Let us define the random variable 



r{M c , tj) = Z ^ u ^ (M<) e € (M(tjy)e-^ w 

= Zo <F«tm J- f 9 e {M k t ) e"^ , (23) 
Nta i k=\ 

where the sum runs over iVtraj independent repetitions of the manipulation process and M k . is 
the value of the variable M along the k-th trajectory, at sampling time tj. We have introduced 
the characteristic function 8 e (M) of the ^-th bin: 

f 1, ifM e <M <M{ + 5M { ; 
9 t (M) = ' ' . (24) 
( 0, otherwise. 

Let 

1 N ^ 

p(M e , tj) = — V em\) e"^ (25) 
yVtra J k=i 

define the stochastic part of the variable r(M e , tj). We use r(M{, tj) to estimate the quantity 

AR(M ( ) = exp [-BT (M ( )] 5M C . (26) 

According to eq. ( j2~2| ) the best estimate for AR{M e ) is given by 

Zp(M e , tj) 
. a tj (M £ )(jj.(M € ) 
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where a t (M e ) is given by 

a tj (M e ) = ^'/ M '\ 
a] (Mi) is given by 

o-\(Md = (p 2 (M { ,tj)) - (p(M e ,tj)) 2 



(28) 



traj 



(29) 



and /I is defined by the normalization condition (j21{). In ref. [|10p, crf(M) is taken to be 



a f (M)' 



(30) 



Note that the quantity appearing on the numerator of eq. ( pQ ) does not necessarily satisfy the 
JE, since the mean is taken over a finite number of trajectories. 

Note also that the rhs of eq. ( |13| ) is equal to the numerator of the fraction appearing on 
therhs ofeq. ©. 



S(M) = ~k S 



(32) 



4. Evaluation of the free energy landscape of a mean field system 

In the following we apply the histogram method, discussed in the previous section, to 
probe the free energy landscape of a known system, namely an Ising model in mean-field 
approximation, whose unperturbed free energy reads 

T (M) = -^M 2 -TS(M), (3D 

where where S (M) is the usual entropy for an Ising paramagnet, 

(N + M\, /N + M\ (N-M\, tN-M\ 
— ) log (—) + (—) log (— 

By using such a mean-field model, we can test how the different system's parameters affect the 
effectiveness of the histogram method to evaluate the free energy landscape. In particular we 
analyze the effect of changing the system size, the interaction parameter J , the manipulation 
protocol, and the manipulation rate. The method described here can be easily generalized 
to systems characterized by any given free energy function, at least as long as the space of 
collective variables remains of small dimensionality. 

The free energy landscape will be probed by applying an external magnetic field h, 
which is manipulated according to a given protocol h(t). We assume that the system evolves 
according to Langevin dynamics, and thus the manipulation process can be simulated by 
numerically integrating the Langevin equation 
dM n dT{M) 

iF-^ir^ (33) 

with 



(7l(t)T](f))=2v Q 6(t-t'), 



(34) 
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and where the total free energy TiM) is given by 

<f{M) = T (M) - hM (35) 

The Langevin equation ([33]) can be integrated using the Heun algorithm [|14j]. 

As discussed in the previous section, by sampling the quantity p(M, t), eq. (p5|), we obtain 
the best estimate for Tq(M) = -k B T\nR*(M), where R*(M) is defined by eq. fl27|). Here we 
adopt the expression ( |30| ) for crj(M). Let us define the magnetization per spin m = M/N, N 
being the system size, then the quantity / ( , (m) defined as 

f*(m) = -^\nR*(M), (36) 

will indicate in the following the estimated free energy per spin, for a given manipulation 
protocol. In order to quantify the quality of each estimate we divide the interval of values of 
m [-1, 1] into N m bins, and define the distance function 

i N m 

d^—YjiMmd-fZimdf. (37) 

As we will see in the next subsections, the quality of the estimate of To(M) via eq. (^) is 
strictly connected to the the quality of the estimate of AF t via eq. (|T3"1). 

In the following, we fix the energy scale and the time scale by taking f3 = 1 and vo = 1. 



4.1. Linear protocol 

We first consider a linear protocol, which reads 

h(t) = h + hl ~ h ° t. (38) 




Figure 1. Comparison of the free energy landscape fo(m) = To(M)/N (full line) with Jq = 0.5, 
with the results of the simulations described in the text. The external magnetic field is varied 
according to the protocol ( |38| ) with h\ = -ho = 1, and ff = 2, 10. The system size is N - 10 
and for each value of ff, A^raj = 10 4 samples of the process are taken. 

In figure [j], the expected free energy per spin fo(m) = < Fo(M)/N, is plotted together with 
the estimated free energy / *(m), obtained with the method described above, for two values of 



Evaluation of free energy landscapes from manipulation experiments 



8 



0.6 
0.5 
0.4 
0.3 
0.2 
0.1 


-1 -0.5 0.5 1 
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Figure 2. Comparison of the equilibrium free energy difference A/, = f^t) — fh a as a function 
of h(t) (full line), with the quantity F*/N, as defined by eq. (|l3|), obtained with the simulations 
described in the text. In these simulations the external magnetic field is varied according to the 
linear protocol (^8|) with hi = -h^ = 1, and tf = 2, 10. The mean field interaction parameter 
/o is taken to be Jq = 0.5. The system size is N = 10 and for each value of tf, M ra j = 10 4 
samples of the process are taken. 

the final time (inverse manipulation rate) tf. This figure clearly shows that only the slowest 
process, with tf = 10, gives a correct shape of the free energy fo(m) for any value of m. 
In figure ||, the quantity AF*/N, is plotted for the two manipulation rates, together with the 
equilibrium free energy difference Af = f^ t ) - //,„, as functions of the external magnetic 
field h(t). Comparison of fig. |T] with fig. [| gives strong evidence that the effectiveness of the 
method here discussed for the reconstruction of the free energy landscape is strictly related 
to its effectiveness in evaluating the equilibrium free energy difference by using the JE. If 
the manipulation protocol is such that the free energy landscape is successfully reconstructed, 
then the estimate of the free energy difference, as given by eq. (JT3J) is close to its expected 
value AF t . On the other hand, one cannot expect Tq(M) to be reliably evaluated if the total 
free energy difference AF t is poorly estimated. This conclusion is confirmed by changing the 
system parameters, e.g., by increasing the system size Af. In figures |3] and |] we plot the same 
quantities, namely / *(m) and AF* /N for a larger system, with Af = 100 spins. Also in this 
case the JE is effective in giving an accurate estimate of the free energy difference AF t , if the 
protocol is slow enough for the free energy landscape to be reconstructed correctly. 

4.2. Oscillatory protocol 

In this subsection, the mean field system is manipulated according to the oscillatory protocol 

h(t) = h Q sin(2^vf), < t < t f . (39) 

We set tf = 2, and take two values (7 = 0.5, 1.1) of the interaction parameter J . The 
frequency v is varied from 1/2 up to 16. The function d, as defined by eq. ( T57[ ) is plotted in 
figure |5] as a function of v, for the two values of Jo here considered. 

In figure || the expected free energy per spin fo(m) is compared to the evaluated free 
energy for some of the values of v here considered, for the J = 0.5 case. Comparison of 
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Figure 3. Comparison of the free energy landscape fo(m) = To(M)/N (full line)with Jo = 0.5, 
with the results of the simulations described in the text. The external magnetic field is varied 
according to the protocol ( ^8| ) with hi = -ho = 1, and ff = 2, 10,30. The system size is 
N = 100 and for each value of ff, A^ tr aj = 10 4 samples of the process are taken. 




h(t) 

Figure 4. Comparison of the equilibrium free energy difference A/, = fa) - fa as a function 
of h(t) (full line), with the quantity F* /N, as defined by eq. (pj|), obtained with the simulations 
described in the text. The mean field interaction parameter Jo is taken to be Jo = 0.5. In 
these simulations the external magnetic field is varied according to the linear protocol ( [38] ) 
with hi = -ho = 1, and ff = 2, 10, 30. The system size is N = 100 and for each value of ff, 
Ntraj = 10 4 samples of the process are taken. 

figures |5] and || clearly indicates that the optimal frequency for the reconstruction of the free 
energy landscape, with 7 = 0.5, does not correspond to the smallest one but rather to v 4. 
The results discussed in subsection |TT] suggest that the estimate of the free energy landscape 
is optimal for a manipulation protocol such that the estimate of the free energy difference 
Af given by the JE is optimal. We thus consider the estimated free energy difference AF*, as 
defined by eq.(|l3]), for different values of the manipulation protocol frequency v, and compare 
it to its expected value, see fig. |7](a). Since we are considering an oscillating protocol here, 
eq. ([39"1), for a given value of h, there will be several estimates of Af for different times 
t separated by the protocol period 1/v . In figure 0(b), the mean value of F*/N, obtained 
by averaging over these different contributions for a given value of h is plotted. As for the 
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Figure 5. Distance function d, as defined by eq. (|3^), as a function of the frequency v, for the 
oscillatory manipulation protocol ([39]). The size of the system is N - 10, and the number of 
trajectories is A^ tra j = 10 4 . The line is a guide to the eye. 
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Figure 6. Plot of the estimated free energy landscape / *(w), obtained with the oscillatory 
protocol (^), for different values of the frequency v, and with Jq = 0.5. The sets of data are 
shifted to improve the clarity of the plot. The full lines correspond to the expected free energy 
landscape fo(m). 

reconstruction of the energy landscape / *(m), the results shown in this last figure indicate that 
the optimal frequency value, for estimating the free energy difference AF t is v - 4. 

We now consider the case J Q = 1.1 and tf = 2. In figure |] the reconstructed free 
energy landscape f*(m) as given by eq. ( ^6] ) is plotted, while in fig. ^| the estimated free 
energy difference AF*, as defined by eq. (|13[), is plotted. The distance function d for the 
value of Jo = 1.1 is plotted in fig. |5|, as a function of the manipulation protocol frequency v. 
Comparison of figures ^ |8] and [5] indicates that, for this value of J , the optimal frequency is 
v - 2, which is smaller than the value we find for the J = 0.5 case. 
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Figure 7. Comparison of the equilibrium free energy difference A/, = //,(,) - _/y, as a function 
of h(i) (full line), with the quantity F*/N, as defined by eq. (|l3|), obtained with the simulations 
described in the text. In these simulations the external magnetic field is varied according to 
the oscillatory protocol (^9|) with ho — 1, and ff = 2. The mean field interaction parameter Jo 
is taken to be Jo = 0.5. The system size is N — 10 and Af tm j = 10 4 samples of the process are 
taken. The sets of data are shifted to improve the clarity of the plot. Panel (b): mean value 
of of F* IN, obtained by averaging the contributions to this quantity for a given value of h, as 
plotted in panel (a). The dotted lines are guides to the eye. 



5. Unzipping of a model homopolymer 

In this section we consider a simple model of homopolymer subject to external forces. We 
aim thus to reconstruct the energy landscape of the polymer, as a function of its internal 
coordinate, namely its extension, via non-equilibrium manipulations. 

The model polymer is made up of N identical beads which interact via a Lennard- Jones 
potential 

"«-5>3-3- <40) 

i=\,j<i l\ r 'J> V'J/ \ 
where r ; y is the distance between the z-th and the j'-th monomers. Successive beads along the 
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Figure 8. Plot of the estimated free energy landscape / *(m), obtained with the oscillatory 
protocol (p^), for different values of the frequency v and with Jq = 1.1. The sets of data are 
shifted to improve the clarity of the plot. The full lines correspond to the expected free energy 
landscape fo(m). 



polymer chain interact also via the harmonic potential 



JV-l 



u 2 = Y J k(nj +i -o-) 2 . (41) 

(=1 

We use here molecular dynamics simulations with Langevin noise: the equations of 
motion of the polymer beads thus read 

mri = F(r f ) - yii + 17(f), (42) 

where m is the mass of the bead, F(r,) is the force acting on the i-th bead due to the interaction 
with the remaining N - I beads, y is the friction coefficient and r]{t) is the random force 
satisfying 

<*7(0) = 0; (43) 
(laWriitfj) = 2k B Ty6(t - t'), a,fi = x,y,z. (44) 



The values of the model polymer parameters are chosen following refs. [|15j, |16|] : the Lennard- 
Jones energy e and distance <x are taken to be e = 1 kcal/mol, a = 0.5 nm, respectively, while 
the monomer mass is taken to be m = 3 • 10~ 25 kg. With this choice of the basic parameters 
one obtains a characteristic time r = ■\Jmcr 2 /e - 3.3 ps. The strength of the harmonic bond 
potential ( |4T| ) is taken to be k = 5000 f/cr 2 , which corresponds to a more rigid bond than those 
considered in refs. [JT3], [16]]. For the friction coefficient we take y = \5m/r. The stochastic 
equations of motion for position and the velocity of the system's beads are solved using a 
modified leapfrog algorithm [[T7|], with an integration time step 6t = 0.005r, and where the 
temperature is fixed to T = 300 K . 

In order to mimic the unfolding of the above described system with an external force 
exerted by an AFM cantilever, the polymer is manipulated according to the following 
procedure: the position of the first monomer of the chain is kept fixed, mimicking the trapping 
in the focus of an optical tweezers of infinite stiffness; at the starting time the last monomer of 
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Figure 9. Comparison of the equilibrium free energy difference A/, = //,(,) - _/y, as a function 
of h(i) (full line), with the quantity F*/N, as defined by eq. (jilt), obtained with the simulations 
described in the text. The mean field interaction parameter Jo is taken to be /o = 1 ■ 1 . In these 
simulations the external magnetic field is varied according to the oscillatory protocol (|9|) with 
ho = 1, and tf = 2. The system size is N — 10 and A^j = 10 4 samples of the process are 
taken. The sets of data are shifted to improve the clarity of the plot. Panel (b): mean value 
of of F* IN, obtained by averaging the contributions to this quantity for a given value of h, as 
plotted in panel (a). The dotted lines are guides to the eye. 



the chain is "attached" to a pulling apparatus with a spring of elastic constant k (equal to the 
"molecular" stiffness appearing in eq. (|4T|)), see figure [K]. The external force is thus applied 
by moving the apparatus along a fixed direction with a protocol z(t). Let £ denote the distance 
of the N-th monomer from the plane containing the first monomer and perpendicular to the 
applied force direction, the external force reads thus F ext = k(z - O- 

As expected, we find that, in the absence of external force, the model polymer is in a 
globular state. Let I be the end-to-end distance of the polymer, i.e., the distance between 
the last and the first monomer of the chain: £ = |rjy — ri|. We observe that in absence of 
external force, this quantity is € = 2.31 + 0.08cr. In order to define a typical collective time 
for the system, we measure the time needed to refold after a complete unfold, which we 
take to correspond to an end-to-end length t = Ncr, we define this time t F , which takes the 
value t F =: 500t for the system size here considered. We also define the characteristic folding 
velocity vp = Ncr/fy - 0.04cr/r. These two quantities define the intrinsic time and velocity 
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scale of the polymer dynamics. In figure |TT] the end-to-end length is plotted as a function of 
the time for a linear pulling protocol, with a constant velocity z(i) = 5 • 10" 5 cr/r . 




Figure 10. Cartoon of the mechanical unfolding of the model homopolymer. The coordinate 
z indicates the distance of the pulling apparatus from the reference plane, while the coordinate 
f indicates the distance of the A^-th monomer from the reference plane, and represents the 
system collective coordinate. 
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Figure 11. Polymer end-to-end length as a function of the time, for a linear pulling protocol, 
with velocity z{t) = 5 • 10~ 5 <t/t. The pulling apparatus is detached from the polymer after a 
fixed time t = 50000t and then the system relaxes with no external force applied for a time 
interval Af = 2500t. After that the external force is applied again. 



We aim now to measure the system intrinsic free energy landscape as a function of the 
internal coordinate £ using the method discussed in section [5| The work done on the polymer 
along a single trajectory reads 

W= dtk[z(t)-£(t)]z(t). (45) 
Jo 
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Following equation (Q), the best estimate for Tq(0 is given by To(z) = 
R*(0 is given by eq. (0), and U, (t) (0 k <- 
here both a linear protocol and an oscillatory protocol. 



-k B T\nR*(0 where 



| [z(i) - (Y ■ As m me previous section we consider 



5.1. Linear protocol 

In this section we consider the linear pulling protocol 

z(t) = Zo + vt, (46) 

where the constant zq is chosen to be slightly greater than the z-position of the N-th monomer 
at the beginning of each trajectory: zo = £(t = 0) + cr/ 100. Here we consider three values 
of the pulling velocity, v = 5 x 10~ 4 , 5 x 10~ 3 , 5 x 10~ 2 cr/r. For each velocity, the duration 
time of the manipulation tf is chosen in such a way that the stroke of the pulling apparatus 
is Az = 25cr, and the polymer is fully unfolded. This corresponds to a time interval of 
tf = 500000, 50000, 5000t for the the three protocols, respectively. For the slowest velocity 
we take 50 repetitions of the pulling process, for the intermediate velocity we take 500 
repetitions, while for the fastest velocity we take 1000 repetitions of the pulling process. After 
each pulling process, the polymer evolves at zero force for a time interval of 5t F = 2500r, 
mimicking the detachment of the pulling apparatus and the refolding of the polymer. 

In fig. [T^ we compare the free energy landscape Tq(0 obtained from the three pulling 
velocities, by using the histogram method discussed in section || Differently form the 
Ising model, in this case, we do not know the expected free energy function. However, in 
order to perform a consistency check one can note that the free energy difference Ai 7 z(f) = 
F(z(t)) - F(z(0)), which is function of the pulling apparatus coordinate z(t), and the free 
energy landscape fo(0 are related via 



AF m = -k B T In 



+ const. (47) 



Our best estimate for AF z(/) is obtained by averaging exp (-/3W t ) over the repetitions of the 
pulling process, as given by eq.(|T3|). In the limit of z — > 0, we expect this estimate to be exact. 
In figure [T3], we compare the free energy difference obtained with direct measuring, eq. (|T3|), 
and that obtained using eq. (|4"7|), for the fastest pulling velocity here used. Inspection of this 
figure suggests that the agreement between the two estimates of AF z(?) is rather good for this 
value of the velocity. The agreement is also good for the two other values of the pulling 
velocity (data not shown). 



5.2. Oscillatory protocol 

Here, the polymer is manipulated by varying the pulling apparatus position according to the 
protocol 

z(0 = ^[l-cos(2*n*)]+zb, (48) 

where the constant zo is chosen to be slightly greater than the z-position of the N-th monomer 
at the beginning of each trajectory: zo = £(t = 0) + cr/100. The value of z max is taken to 
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Figure 12. Reconstructed free energy landscape J? as a function of the polymer internal 
coordinate f, obtained with the linear protocol (p^), for the three pulling velocities here 
considered. The line, in the case of the faster velocity, is a guide to the eye. 




Figure 13. Free energy difference AF as a function of the pulling apparatus coordinate z, for 
the linear protocol (Sq), with the largest pulling velocity here used z — 5 x 10~ 2 ct/t. Squares: 



free energy difference AF obtained using the JE (13). Full line: free energy difference AF as 
given by eq. (^7j). 



be z max = (N + 4)cr, in such a way that the polymer is fully unfolded near the maximum of 
the function (^8[). Three values of the frequency v = 5 x 10" 6 ,5 x 10~ 5 , 5 x \0~ A r~ [ are 
considered here. This values have to be compared with the system characteristic frequency v F 
as estimated in section |5], Vp = l/fy - 2x lO" 3 ^ 1 . Let us define the effective velocity 




the three frequencies here considered correspond to the values of the effective velocity 
v e ff - 2.66 x 10~ 4 , 2.66 x 10" 3 , 2.66 x 10" 2 cr/r respectively. These velocities have to be 
compared with the characteristic folding velocity of the polymer as estimated in section Q 
vp = 0.04 cr/r. We adopt two different approaches to manipulate the polymer: in the first 
case the pulling apparatus is always attached to the polymer during the whole manipulation 
time tf, fig. [14|( a X while in the second case the pulling apparatus is detached after one and 
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half period 1 /v of the protocol, the system equilibrates at zero force for a time interval of 
5t F , and then the force is applied again, see figure [T^(b). In the case where the pulling 
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Figure 14. Polymer end-to-end length as a function of the time, for the periodic manipulation 
protocol (^|), with frequency v = 5 x 10 _4 t _1 . The dotted line represents the mean value of the 
polymer end-to-end length in absence of external force. Panel (a): the pulling apparatus stays 
in contact with the polymer during the whole manipulation process. Panel (b): the pulling 
apparatus is detached from the polymer after a fixed time 1.5/vt and then the system relaxes 
with no external force applied for a time interval Af = 2500t. After that the external force is 
applied again. 



apparatus is attached during the whole manipulation process, we take a total manipulation 
time tf = 10 7 r. In the case where the pulling apparatus is detached after one and half period, 
we consider 50 trajectories for v = 5 x 10~ 6 , 500 trajectories for v = 5 x 10" 5 , and 1000 
trajectories for v = 5 x 10 -4 . The results for the reconstructed free energy landscape with 
these two manipulation strategies are plotted in fig. [T5|. Inspection of figure |T5|(a) clearly puts 
in evidence that the "always attached" protocol (fig. [R|(a)) gives a good estimates for the free 
energy landscape only for the smallest frequency here considered v = 5 x 10~ 6 t~ 1 , which 
corresponds to an effective velocity v eff = 2.66 x 10~ 4 cr/r; while for the two other frequencies 
the reconstructed free energy landscape is completely wrong. This can be easily understood 
by looking at fig. IT^I: after a complete unfolding, if the molecule is pulled leftwards too fast, 
it cannot achieve the native globular state, and so the internal coordinate will be no longer 
a "good" collective coordinate to describe the system state. Note that the periodic protocol 
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Figure 15. Reconstructed free energy landscape T * as a function of the polymer internal 
coordinate obtained with the oscillatory protocol ( |48| ) for the three frequency v here 
considered. The full line is the "reference" free energy landscape To obtained with the linear 
protocol ( p^ ) with the smallest velocity v = 5 x 1CT 4 cr/r. Upper panel: the free energy 
landscape To is reconstructed using the "always-attached" manipulation protocol, fig. [l4j(a). 
Lower panel: the free energy landscape To is reconstructed by periodically detaching the 
pulling apparatus, fig. |l4](b). 

proves unsuccessful to recover the energy landscape for frequency well below the system 
characteristic frequency v F . 

In the case of the second manipulation strategy, the reconstructed energy landscape, fig. 
p3|(b), agrees with that obtained with the linear protocol for the two smallest frequency here 
considered. On the contrary, the reconstructed energy landscape obtained with the largest 
frequency v = 5 x 10 r 4 is clearly inaccurate. 

It is worth to note that for our purpose, i.e. the reconstruction of the free energy 
landscape, the "pulsed" protocol, represented in figure [njb) is to all extent equivalent to 
the linear protocol (ftp]). 

6. Discussion 



In the present work we have combined the extended form of the JE, eq. dT2|), and the 
histogram method to reconstruct the free energy landscape of two simple systems driven out 
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Figure 16. Upper panel:Cartoon of the polymer manipulation. The polymer is manipulated 
with the oscillatory protocol (|48|). If the polymer is manipulated too fast, it cannot attain the 
globular native state after one manipulation cycle. Lower panel: snapshots of the polymer 
configuration, at two different times of a simulation run with v = 5 x 10 r _1 , projected 
onto the z — x plane. Empty circles-full line: Configuration at t = 0, i.e. the system is 
at thermodynamical equilibrium with no external force applied. Full circles- dotted line: 
configuration of the system after one manipulation period. The cross indicates the fixed 
monomer, the arrows indicate the monomers to which the force is applied. 

of equilibrium by manipulation of an external parameter. 

In the case of the Ising model in mean field approximation, the external magnetic field is 
manipulated both with a linear and with a periodic protocol. In both cases, for a sufficiently 
gentle protocol, the system free energy landscape is successfully evaluated. It is worth to note 
that, for the periodic protocol, the optimal frequency for the reconstruction of the landscape 
is somewhat larger than the smallest frequency here considered. This indicates the existence 
of a typical system frequency, which optimizes the estimate given by the histogram method, 
as already found in JlOj]. However, we point out that this typical frequency is of the order 
of the frequency governing the system dynamics, which has been taken equal to one in the 
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present work. This means that the manipulation has to be performed on time scales similar 
to the system characteristic time scale, in order for the free energy evaluation method here 
discussed to be successful. Faster manipulations give unreliable estimates of the free energy 
function. In the case of the linear protocol we also consider the effect of the system size on 
the effectiveness of the histogram method. As discussed in refs. p2] , [T3[ ], changing the system 
size N corresponds to change the system energy scale. There, we showed that one can obtain 
a good estimate of the free energy difference, via the JE, only for small system sizes (small 
energy scales). Similarly, the results of the present works indicate that the histogram method 
is effective for small system sizes. This conclusion widens the results of refs. [^|, [l(|| on the 
histogram method, since in those references the effect of the energy scale was not considered. 

The second system here considered is a simple model of homopolymer, which is 
unzipped by applying an external force to one of its free ends. Also in this case the external 
force is varied both with a linear and with a periodic protocol. The results of this simulated 
experiment have to be considered more carefully, with respect to the case of the Ising model, 
since we do not know the exact shape of the polymer free energy landscape. We take as 
our best estimate of this landscape the one provided by the linear protocol with the smallest 
velocity. We find that the periodic force gives unreliable estimates of the free energy as 
a function of the polymer elongation, even for frequencies much smaller than the system 
characteristic frequency. This is at variance with the conclusions of ref. [|T0"|], where the 
periodic loading was found to be the optimal one for the evaluation of the free energy 
landscape of a model polymer. The reason for this discrepancy resides in the fact that our 
model polymer takes also into account the three-dimensional structure of the system, and 
when a periodic force is applied, the elongation coordinate is no longer a "good" collective 
coordinate, and fails to catch the connection between the system macroscopic state and its 
microscopic state, as depicted in fig. WR. In fact, the system has no time to recover its initial 
globular state, and keeps memory of previous trajectories at each manipulation cycle. 

Our results suggest thus that in the realization of a real experimental set-up, if one wants 
to exploit the histogram method to evaluate the free energy landscape of a polymer, some 
care has to be taken with the choice of the manipulation protocol. The linear protocol, or the 
"pulsed" sinusoidal protocol, appear to be the best choices to this purpose. This is closely 
related to the original proposition of the JE, which states that the equality holds if the system 
is in thermodynamical equilibrium at the beginning of the manipulation. 

Finally, we have found that the polymer elongation is not a good state variable to describe 
the system when the manipulation occurs on too short times, since the system is not able to 
reach a quasi-equilibrium state defined by its instantaneous value. In this case, the concept of 
a free-energy landscape depending on this coordinate is ill-defined. 
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